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ABSTRACT 

Criteria used by states for review and approval of 
academic programs were investigated in 1983 based on' a survey of 
boards of educe t ion of states belonging to the State Higher Educetion 
Executive Officers (SHEEO) • The survey revealed an overall increase 
in state-level program review activity. While the general criteria 
for program review and approval were very similar from state to 
state, differences were found for specific indicators of each 
criterion and the weight given to each criterion. In general, the 
criteria related to the purposes of the review end the type of board. 
Typical general criteria included: quality, need/demand, relation to 
institutional mission, cost for new programs, and productivity for 
existing programs. The existing and/or potential duplication of a 
program was also frequently included as an evaluation criterion. 
There was increasing use of simple outcomes measures (e.g., 
information on program graduates, success on required professional 
examinations, entrance to graduate schools) in the review of existing 
programs. For the 50 states, the District of Columbia, and Puerto 
Rico, a chart indicates the authority of the state to recommend, 
approve, or discontinue programs by type of college/university. Maps 
also illustrate states where the board has program approval/review 
authority. (Sff) 
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Introduction 

The last two decades have witnessed the development and expansion of statewide 
governing and coordinating boards for higher education 1n nearly every state. 
This development was spurred on In the 1970s by the federal government's role In 
fostering the development of the so-called "1202'' Postsecondary Educational 
Planning Commissions (McGutnness et al-, , 1975). The specific responsibilities 
of the state 'boards for higher education vary from state to state, but, In 
general, three major areas have been Identified 1n which most boards have some 
responsibility. These three areas are budget development, planning, and program 
review and approval (Berdahl, 1971, and Glenny et al., 1971). Of the three 
areas, program review and approval, because of Its close relationship with the 



academic function of colleges and universities, has been the most controversial. 
Earlier studies of state-level program review and approval have noted this 
controversy and reported the status of state-level review and approval 
activities (Barak and Berdahl, 1978; Barak and Engdahl, 1980; and Barak, 1979). 
More recently, several national commissions have addressed the Issue of 
state-level academic program review, thus highlighting this function of state 
higher education boards (I.e., National Commission on Higher Education Issues, 
1982; Education Commission of the States, 1980; Sloan Commission on Government 
^nd Higher Education, 1980; Carnegie Foundation for the Advancement of Teaching, 
1982). This report represents a 1984 update on the status of state-level 
academic program review and approval. 

Past Surveys 

In 1978, a comprehensive report on the status of state-level academic program 
review and approval described, for the first time, the nature and extent of the 
program review and approval activities of state higher education boards (Barak 
and Berdahl, 1978).' The report noted that 1n 1975,^47 state boards had 
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had authority to approve at least some net* programs or had authority to review 
at least some existing programs. With few exceptions, this authority was 
directed primarily at public colleges and universities. In eight states, this 
authority was limited to making recommendations to appropriate officials (I.e., 
the governor, legislature, *nd Institutional boards of trustees and/or 
officials). In the remaining state boards that had authority for program review 
and/or approval 1t was possible for the boards to actually disapprove new 
programs and/or discontinue existing programs. - 

Five National Panels Recommend Program Review 

Since the Barak and Berdahl study, at least five national panels have addressed 
the role of the states, and particularly state higher education boards, In 
program review and approval. While all five were highly supportive of the need 
for systematic program review, four reports felt that the appropriate focus of 
this activity should be at the Institutional level, while one suggested that the 
reviews be a cooperative endeavor between the state boards and the Institutions. 
The latter, a panel convened by the Education Commission of the States 1n 1980, 
after examining the problems and Issues facing the states 1n the 1980s , 
concluded that: 

With variable enrollments and fiaoal stringency, review of existing 
as well as review of new program will become progressively important, 
in some states program review needs to be strengthened and related 
to the enters planning, budgeting and coordinating process. A frag- 
mented and ad hoc approach will not be helpful in protecting educa- 
tional values tn a period of decline. 

1. Program iw^ eon help to keep postsecondary education vital 
by encouraging curtailment or closure of program that no longer 
serve student needs and by helping the development of needed new 
programs. Effective program review must involve both the state 
higher education agencies and the institutions and combine insti- 
tutional and statewide perspectives. It should be clearly related 
to institutional missions. 
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* F °* *** 1990e proposals for new programs should be carefully 
demhspsd by the institutions and their planning staffs with 
figtftfiaZ attention to needs, costs and resource reallocation. 
The state agency should relate program review to state as well 
as to institutional objectives and thus to the planning process. 

e Review of existing programs, which will receive increased 
attention during this decade, should incorporate both quali- 
tative and quantitative dimensions of student need, program 
duplication and program effectiveness. In light of the deeply 
engrained reliance in the academic community on peer group 
evaluation for qualitative judgments, where feasible and pos- 
sible, careful use of outside consultants should be considered. 

2. Program review needs to be developed through the participation 
of institutions and their faculty and of the statewide higher 
education agency and with the cooperative reinforcement of the 
legislative and executive branches of state government. .The im- 
portance of a state perspective does not mean that the state should 
carry out academe program review unilaterally. Institutional and 
faculty cooperation is essential to the integrity of the review 
process and to the coordination of state and institutional efforts. 

e The criteria for program review should be developed jointly by 
state higher education agencies and institutions. Criteria 
should be thoroughly understood by administrator a, faculty and 
other interested parties incU-Hng the executive and legislative 
branches of state government. *he process should be as objective 
as possible and include conditions for appeal and review. 

e When possible, independent institutions should be given the 
opportunity and should be encouraged to participate voluntarily 
m the program review process. 

e Program review should be based on the premise that it is a way 

to enhance the qualify of education as well as a way of controlling 
costs. Bowever, program review is limited by costs, so careful 
consideration must be given to a credible process for the selec- 
tion of programs for review. (Education Commission of the States. 
2980, p. XV.) . 



While the direct Involvement of state boards In the program review process was 
not encouraged by four other national panels composed primarily of 
representatives of college and universities, there was some recognition that 
state-level action might be needed in certain circumstances such as large 
expensive proqrams and to encourage by various means systematic reviews at the 
Institutions. The Carnegie Council, In Its final report, suggested that: 
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We are doubtful about state-mandated review of academic programs. 
We believe that such review is better conducted by the institutions 
themselves, by the accrediting agencies, and by the students making 
their choices; and we question the wisdom of this, great an intrusion 
into academic affairs. Unite we are against any fine-tuning of academic 
program by state action, we recognise that the state may need to step 
in where there are very expensive large programs (like medical schools) 
in severe duplication of each other. (Carnegie Council on Higher 
Education, 1980, p. 124.) 



The Sloan Commission, while noting many of the difficulties facing higher 

education concluded that 

The commission recommnds that each state arrange for a periodic re- 
view of the quality of educational program at every public college and 
university within the state. The reviews should be conducted by aca- 
demic peer groups, not by state employees. To the greatest extent pos- 
sible, existing accrediting mohanism, such as the regional and profes- 
sional accrediting associations, should ">e drawn on to organise and 
conduct the reviews. 

Any governmental effort, whether state or federal, to evaluate the 
quality of education arouses profound uneasiness throughout the higher 
education community. It is seen as a threat to institutional autonomy 
and academic freedom. (Sloan Commission on Government and Higher Educa- 
tion, 1980.) 

The National Commission on Higher Education Issues sponsored by the American 

Council on Education also urged state boards to encourage rigorous Institutional 

program reviews while spelling out a partnership role for state board staff. 

Specifically, the National Commission recommended 

". . . that governing boards ensure that all institutions under 
their jurisdiction have in place procedures for systematic program 
evaluation. Coordinating agencies should, appropriately, see that 
all public institutions and those independent institutions which re- 
ceive direct, state support subject their program to a rigorous process 
of evaluation. The actual program evaluations should, however, be 
conducted at or before the level of the institutional governing board 
and should include extensive peer group Judgments. 

Staffs of statewide coordinating boards and other public agencies 
concerned with higher education can, by wise and diplomatic prodding, 
, become important components of the educational governance structure 
This, their staff members should be selected and compensated as befits 
their important role. They should then be treated by university and 
college leaders in an open and informative fashion as partners rather 
than as adversaries. ,_, _ . _ . . 

(The Carnegie Foundation for the Advancement of 

Teaching, 1982, p. 81) 
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The Carnegie Foundation for the Advancement of Teaching took a similar position 
to that of the National Commission 1n Its recommendations 

Statu officials have generally respected the independence of the 
campus. Today s however, under the pressure for accountability, the 
trend is in the opposite direction. Some state agencies have become 
deeply involved in educational matters, including the evaluation of 
academic programs (p. 80). 

In academic matters, the integrity of the carpus should be fully 
protected. State officials should not involve themselves directly in 
the review of academic program. Bather, they should call upon higher- 
learning institutions periodically to assess such program and report 
their findings (The -Carnegie Foundation for the Advancement of Teaching, 

1982, p. 81). 

The Present Findings 

In July 1983, a survey was distributed to the state higher education boards that 
are members of the State Higher Education Executive Officers (SHEEO) for the 
purpose of ascertaining the current nature and extent of authority of these 
boards In academic program review and approval. Surveys were sent to all 
current SHEEO members and responses were received from all but four of these 
states.* 1 

Three major trends emerge from the survey results. First, there has been an 
expansion of state higher education board activity and/or authority 1n program 
reviews and approval, resulting 1n an overall Increase 1n state-level program 
review activity. Secondly, the reviews themselves have become more 
comprehensive and systemic. Third, the reviews of existing programs appear to 
be more closely Integrated Into the planning and budgeting activities of many of 
the state boards.** 

* Information on program review and approval was subsequently obtained through 
follow-up efforts about the situation In non-responding states. 

** It should be noted that 1n a recent separate study or program review at the 
Institutional level, the author found similar trends. (See Barak, 1982.) 



ERIC 



«• £ • 



Approximately one quarter of the states reported that their activities and/or 
authority In the area of program review and/or approval have expanded In recent 
years. In some states where the board previously had authority for program 
review but had not exercised 1t, reviews were now taking place or were under 
consideration. In other states, new authority for review has heen given to the 
state board. Consequently, the nature of the expansion varies on a continuum 
ranging from Increased attention to the review and approval function to new or 
expanded statutory authority. Among the reasons given for this expansion of 
activity were the following: ; 

1. Concerns about academic quality. ^ 

2. Desire for greater accountability. \ 

3. Greater financial restraints requiring the careful distribution and 

/ 1 
redistribution of scarce resources. \ 



4. Need for greater flexibility In retrenchment. 



The typical rationale for the expansion of program review activity 1s perhaps 
best Illustrated by quotations from actual state documents. The recommendations 
of a study panel In the state of Georgia Illustrates the concerns about academic 
quality and the desire for greater accountability. 

■ i 

QUALITY 

The most important task fading the University System in the eighties 
and beyond is the improvement of the quality of public higher education. 
The success of the System in the sixties and seventies was often measured 
by one factor growth. To meet dramatic increases in enrollment, 
program, facilities, and institutions were added with alacrity. The 
success of the System in the years ahead will be measured not in terms 
of grrwth but in terms of the level of quality by which Georgia's citizens 
are provided with the knowledge and expertise necessary to address critical 
social, economic, and technical problems. Each decision made by the Board 
of Regents must be governed by the principle of quality improvement. The 
University System must develop the mans of evaluating the performance of 
its institutions against those standards that have been identified as 
the best nationally. / 
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While adequacy of funding will play an important role in the attain- 
ment of an increased level of quality M funding alone is not the only com- 
ponent of a needed program of quality improvement. 



The coordinating Committee for the Statewide Seeds Assessment 
recommends that: 

• the Governor, the Legislature, and the Board of Regents establish 
quality improvement as the top priority for public higher edu- 
cation in the state for the eighties and beyond and that this 
priority be made known to the citizens of the state; that, in 

so doing, the quality improvement funding recommendations of 
the Study Committee on Public Higher Education Finance be adopted 
and implemented, 

e the Board of Regents and the State Board of Education expand 
the present base of cooperation into a wide-ranging creative 
partnership to examine issues of mutual concern and to develop 
strategies aimed at the development of excellence in all areas 
of the educational endeavor; thai local school systems and unite 
of the University System develop a systematic mode of communica- 
tion, allowing frequent exchange of ideas and information' and 
designed to enhance the interdependence of the levees of education 
they represent. 

e University System institutions further develop creative partner- 
ships with local community, business, and industrial leaders 
to ensure their acquaintance with the problems and potential of 
each inetutution and the System, their knowledgeable advocacy 
of public higher education, and their participation in the formu- 
lation of institutional and System goals; that these groups be 
encouraged to assist the institutions in obtaining private funding 
support which often spells th*> difference between adequacy and 
^excellence. 

• the Board of Regents develop and imlement a system of program 
evaluation for institutional and System-wide utilisation, with 

the establishment of specific qualitative criteria which lend them- 
selves to measurement; that this system of program evaluation be 
designed to involve both internal and external evaluation to ensure 
results that are both disinterested and objective. 

e the Board adopt as a long-range goal the elimination of the need 
for Devel opment al Studies as that program is currently constituted; 
that this goal be adopted with the understanding that the results 
of past deprivation of educational opportunity will long remain 
and that the need for compensatory education must be met so long 
as necessary in order not to block access to higher education 
for those who are capable of eliminating academic deficiencies for 
which they may not be totally responsible; that close cooperation 
with the State Board of Education be made the cornerstone for 
achievement of this goal, recognizing that academic problems are 
best addressed as they develop, not after-the-fact. 
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e the Board encourage phe reinetitution of specific academic re- 
quirements for admission to System institutions to include emphasis 
on laboratory sciences, foreign languages* mathematics, and writing 
skills; that the public be made more clearly aware of achievement 
expectations at the entrance level. 

* the Board develop and find a program of System-vide faculty de- 
velopment designed to ensure that faculty member* have adequate 
opportunity to keep up-to-date in their disciplines and to enhance 
their teaching skills. 

The concerns about quality and accountability are also evident In the quote 



below from the report and recosn»ndat1o<nsof a group of consultants engaged to 
evaluate the Alabama Commission on Higher Education, In addition, this example 



notes a concern 
on the part of 



frequently noted elsewhere In which the lack of accountability 
colleges and universities (and thejr respective boards) 1n 
undertaking their oy rigorous program reviews provides a convenient rationale 
for others located outside the Institutions to take the Initiative on the 
reviews. After noting that the process of program approval (I.e., the review of 
new programs) 1s working reasonable well 1n Alabama, the consultants explain 
their rationale for a greater commission role 1n program review. 
Program Review and Evaluation 

Program evaluation rarely is a simple matter. ' The, process in 
which a new program begins within the faculty of an institution, moms 
through peer review, passes adtenistrative scrutiny and board approval, 
and then is subjected to approval by a statewide commission may reflect 
several different sets of needs and standards. At each step judgement 
ts made more cautious by the propsect of review. On the whole the 
system seems to work well in Alabama. 

There is far less rationality in the review of existing programs. 
Moet programs serve well because they are kept up to date by faculty 
interest and an occasional change of course title. Many die quietly 
for lack of students. Others linger on without much enthusiasm or 
notice. It ^the spectre of those few persistent and marginal courses 
and programs which disturbs everyone when, resources are scarce and needs 
are great. Thus far the trustees of the institutions "have not given 
the public reason to believe that they are dealing with the problem 
satisfactorily. 
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The Alabama Comtission is charged with "The nee of advisory com- 
mittees to study needless duplication of education, research, or service 
program, and programs which are not adequately provided in the state 
. ♦ . * Its report* are to go to the institutions, the Governor and the 
Legislature. Mew program are likely to be identified in the planning 
process through the Council of Twenty-One and other groups. For the 
Commission to live up to its legislative mandate and for the system to 
be credible in it* stewardship, review of program which may be unneces- 
sarily duplicating or unproductive needs to be made. The Committee 
recommends that 

the comassm should establish a process to review 

EXISTING PROGRAMS AMD REPORT ITS FINDINGS TO THE 
INSTITUTIONS, THE GOVERNOR AND THE- LEGISLATURE, AND 
TO THE PUBLIC. 



A third example Is Indicative of those states where programatlc duplication, 

generally referred to as "unnecessary duplication," has been a focus of concern. 

In 1979, the Kentucky Council on Higher Education resolved that a committee 

should be formed to examine the trends and Issues likely to affect Kentucky 

higher education In the future. In 1981, the committee established for this 

\ purpose Issued Its report In Pursuit of Excellence . The report contained a 

number of recommendations, several of which were concerned with program review 

Issues. With respect to both Master's and Doctoral programs, recommendations 

were aimed at ". . . giving specific attention to the identification of program 

duplication 1 * (p. 65). The report noted that: 

In the absence of strong evidence that the duplication 
of a program is "necessary, * the Council should dealaire it 
to be "unnecessarily duplicative'' and, in the case of a 
requested new program, deny its approval. In the case of 
an existing program that is declared to be "unnecessarily 
duplicative, " the Council should withdraw approval, and 
the institution affected should accept no new students 
into the program and terminate it when enrolled students 
have completed their studies (p. 66 J. 
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Program Review %■ 

Program review of existing academic programs by state higher education boards 
has grown from only a handful of states 1n 1960 to forty-three (43) boards in 
1983. In addition, there are several state higher education boards that have 
authority 1n this area but have not fully exercised that authority to date. 

i 

- . > t 
Table 1 shows the number of SHEEO agencies that have authority to recommend and 

actually discontinue academic programs by sector and I type of institution. 

Sixteen (16) boards have authority for" making recommendations for pub? . 

two-year and four-year Institutions, and eighteen (18) for public universities. 

Only one (1) state has authority to recommend with respect to all independent 

Institutions, ana two (2) have recommending authority with respect to some 

Independent institutions. 



2 YR. 
16 



Table I 

AGENCY PROGRAM REVIEW OF 
AT LTAST SOME EXISTING ACADEMIC PROGRAMS 

x AS OF jblY I, 1983 



RECOWEND ONLY 



APPROVE 



PUBLIC 



4 YR. UNIV. 

16 18 
^ 



independent 
all some 

12 



PUBLIC 



2 YR. 4 YR. 
21 



22 



INDEPENDENT 

UNIV. ' ALL SOME 
23 13 



The authority to actually discontinue at least son* programs exists in 
twenty-one (21) states for public two-year institutions, and twenty-two (22) for 
public four-^year Institutions. Twenty-three (23) states have authority to 
discontinue public university level programs. Discontinuance authority over the 
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Independent sector 1s limited to three (3) states with authority to discontinue 
programs at some Institutions, and only one (1) with authority to discontinue 
programs at all Institutions In the state. The states with recommending and 
discontinuance authority over at least some programs are shown In the map 1n 
Figure 1. Figure 2 shows states with authority to review at least some programs 
in Independent Institutions. 

Program Approval 

Program approval 1s the process by which new programs are proposed and approved 
or , „«mended for approval by state postsecondary education agencies; In I960, 
there were twenty-four (24) state higher education boards that had at least some 
program approval authority. In 1983, there were forty-seven (47) state boards 
that had at least some progras. approval authority, almost doubling the number In 
1960. 

Table 2 shows a breakdown of the SHEEO agencies' authority for program approval 
of at least some academic programs. Seven (7) agencies have authority to recom- 
mend approval for public two-year and four-year Institutions, and eight (8) have 
authority for making recommendations for universities. Two (2) states have 
authority to recommend approval for all Independent Institutions, and two (2) 
for some independent Institutions. Generally, such authority means that the 
state higher education board can recommend approval to some other body (I.e., 
legislature, governing board, etc.). N 

Approval authority for public Institutions exists in thirty-four (34) states for 
two-year* and four-year Institutions and 1n thirty-nine (39) states for 
universities. Four (4) states have authority to approve new progralte for all 
independent Institutions and an additional nine (9) states have authority to 
approve only some new programs for Independent Institutions. Usually, the 

13 
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latter are Indicative of exceptions provided for existing Independent Institu- 
tions at the time that the law 1s passed, excluding them from the need to seek 
approval. In other Instances, the exceptions represent in-state Institutions 
which are not typically included in regulations requiring licensing and approval 
of out-of-state institutions wishing to offfer courses or programs within a 

* -A 

state. ' 



Table 2 

SHEEO AGENCY PROGRAM APPROVAL (i.e., NEW PROGRAMS) 
OF AT LEAST SOME ACADEMIC PROGRAMS 
AS OF JULY 1, 1983 

RECOMMEND ONLY APPRO VE 

PUBLIC INDEPENDENT PUBLIC INDEPENDENT 



2 YR. 4 YR. UNIV. ALL SOME 2 YR. 4 YR. UNIV. ALL SOME 



7 7 8 2 2 34 34 39 4 9 



Figures 4 and 5 show a map of the states Indicating the states with recommending 
and approval authority for new academic programs and states with authority over 
at least some independent institutions. 



Purposes of Review and Approval 

There are almost as many reasons and combinations of reasons for state board 
review and approval of academic programs as there are state boards. Typical 
reasons for review and approval Include: maintenance of quality, resource 
allocation and re-allocation, demonstration of need, consumer protection and 
accountability. The purposes also vary somewhat by the type of board, with 
governing boards generally (but not exclusively) more concerned with quality and 
resource Issues, and coordinating type boards more concerned with accountabll- 
ty, state-wide need and consumer protection. 
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FIGURE 3 SHEEO STATES WERE AGENCY HAS AUTHORITY TO APPROVE OR 

RECOMMEND FOR APPROVAL AT LEAST SOME ACAOEMIC PROGRAMS 
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. Table 3 shows the review and approval authority by state. 

Table 3 

SHEEO AGENCY PROGRAM REVIEW/ APPROVAL 
AUTHORITY FOR AT LEAST SOME ACADEMIC PROGRAMS 
as of July 30, 1983 
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Criteria for Review and Approval 

The general criteria for review and approval of academic programs are very 
similar from state to state, but they differ with respect to the specific 
Indicators of each criterion and the weight given to each criterion. In 
general, the criteria relate to the purposes of the review and the type of 
board. Typical general criteria Include: quality, need/demand, relation to 
Institutional mission (I.e., centra 11ty), and cost for new programs; and 
quality, relation to mission (I.e., central Ity), need, cost and productivity for 
existing programs. The existing and/or potential duplication of a program with 
other similar programs In the state 1s also frequently Included 1n the criteria 
by which program are judged. A trend of sorts that was identified In this 
study 1s the Increasing use of simple outcomes measures (e.g., Information on 
program graduates, success on required professional examinations, entrance to 
graduate schools, etc.) 1n the review of existing programs. About ten (10) 
states have Indicated the use of such measures. 
SH/3 V s * 
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